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ABSTRACT 

Development has traditionally been seen as part of a 
one-way street running from the researcher to the practitioner. 
Studies of the "mutual adaptation" of development products undercut 
this view of development and suggest that it should be seen as a 
two-way street that takes into account the practical knowledge of 
teachers and administrators. A participant observer study of two 
efforts at "collaborative" development in the fields of basic skills 
and career preparation illustrate the kinds of practical knowledge 
that practitioners bring to the process and the changes in 
development processes that result. The study concludes that the 
practical knowledge of practitioners, linking agents, and developers 
all contribute to the development process, in addition, development 
products need to provide enough flexibility to encourage intelligent 
local adaptation, but enough guidance to really provide educators 
with new knowledge. (Author/PN) 
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Abstract 

Development has traditionally been seen as part of a one-way street 
running from the researcher to the practitioner. Studies of the "mutual 
adaptation" of development products undercut this view of development and 
suggest that it should be seen as a two-way street that takes into account 
the practical knowledge of teachers and administrators. A participant 
observer study of two efforts at "collaborative" development illustrate 
the kinds of practical knowledge that practitioners bring to the process 
and the changes in development processes that result- The study concludes 
that the practical knowledge of practitioners* linking agents* and devel- 
opers all contribute to the development process- In addition, development 
products need to provide enough flexibility to encourage intelligent local 
adaptation, but enough guidance to really provide educators with new 
knowledge , 
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KNOWLEDGE USE IN EDUCATIONAL DEVELOPMENT: 
TALES FROM A TWO-WAY STREET 



Educational development has been seen as a one-wey street running 
from the researcher to the practitioner* The National Science Foundation 
defines development as "the systematic use of scientific knowledge directed 
toward the production of useful materials, devices, systems, or methods..." 
(quoted in Schutz, 1970, p. 41), and development has been seen as the mid- 
point in a three-step process leading from research to dissemination 
(Havelock, 1973). 

Ironically, research — specifically studies of the implementation of 
innovations — has contributed to the declining interest in development in 
recent years. These studies raise questions about one-way strategies by 
indicating that practitioners are active assessors and modifiers of devel- 
opment "p r °ducts." Through processes of cooperation, mutual adaptation, 
and local reinvention, educators customize development outputs in light 
of local circumstances, values, and beliefs (Greenwood, Mann, and McLaughlin 
1975; Rice and Rogers, 1980), The extent of these changes raises serious 
questions about the utility of research based development* Meanwhile a 
number of alternatives have been created including the use of "linking 
agents" (Hood and Gates, 1978; Louis, 1977) and the sort of school-based 
development funded by Title IV-c. 

Perhaps because the models for educational development in the late 
'60s were areas like defense and NASA where development was so research 



based (Bailey, 1970J , developer.^ often ignored the potential contribution 
th.?i educator*' prn.uirnl knowledge- could make* Piactical knowledge is 
atwJa>;<Hid to th<! replica! doctor's clinical experience which "giv^s the 
doctor the knowledge he needs to treat patients successfully, even though 
that knowledge has not yet been systematized and scientifically verified, 
Ono dr<s not •icquirt *"hxs knowledge through academic study but by seeing 
* ljni<\jl phenomena atu 1 dealing with problems first hand*' (Becker, Ge*+r, 
Hughes, and >trauss, 1961 t p* 231) * Even research knowledge is based on 
experi»>r<-t' analagous co practical knowledge. According to Campbell 
( 1 0 7 v , p. 2), "Even for the strongest sciences, the theories believed to' 

mio are radically underjustif ied In any setting in which we seek 

Lo ;;:iin new knowledge, we do so at the expense of many presumptions,... 
While the appropriateness of some presumptions can be proved singly or in 
snail sets t this can only be done by assuming the correctness of the great 
huik of other presumptions/ 1 The generality and ncrrownass of scientific 
findings create problems for practitioners who work in specific, aulti- 
iacoted settings. Practical knowledge is used to fill the void. 

How can developers incorporate practical knowledge into their products t 
and) for that matter, what sources of practical knowledge are most 
important? One useful time for building in s*uch knowledge comes during 
the pilot testing and field testing stages of development when practitioners 
have the opportunity to use and react to new products. Recently, Research 
for better Schools (RBS) began a long-term development effort that was 
characterized by, among other things, an attempt at "collaborative" devel- 
opment which would at a minimum take practitioners input very seriously 



in revising and reformulating its work by bringing practitioners into the 
development process* Case studies of development groups at RBS working 
in two different substantive areas illustrate the dynamics of a develop- 
ment process relying heavily on practitioner input, the kinds of practical 
knowledge on which practitioners rely when responding to new products, and 
the kinds of revisions that result. To illustrate the dynamics of this 
development and revision process, this paper will describe the initial 
Intentions for what would be developed, practitioner responses, and how 
the revisions were made* Comparison of two cases suggests both regularities 
in the development process and possible sources of variation. 

The Case Studies 

Since it vas founded in 1966* RBS has been active in the development 
and dissemination of such educational products as Individually Prescribed 
Instruction and Experience-Based Career Education. In 1977 it began long- 
term efforts to develop "approaches" that the staff of state departments 
ot education and regional educational service agencies and curriculum 
experts in large school districts could use to help schools improve pro- 
grams in a specific curriculum area. The central core of each approach 
was to be a flexible set of steps or procedures for identifying improve- 
ment needs in a particular curriculum area and then selecting the specific 
4*1uiif*0(jri required for meeting those needs. Typically, the approach would 
entail some sort of data-based assessment of local wants and conditions, 
a decision process through which school personnel selected changes to be 
implemented, and some implementation activity. Each approach would be 



partially embodied in a set of written materials~-manuals, work sheets, 
reference graphs, and so forth — but use of the vproaches in specific 
contexts was expected to reqv ire special adjustments in each case. Hence, 
RBS expected to develop the materials for school use and then train out- 
side experts who would help school people use the materials and follow 
the procedures in specific instances. 

Two of these approaches were in the fields of basic skills and 
career preparation. Each was developed by a work group consisting of 
(1) field staff who presented approaches to school personnel and initially 
modeled the role of the external helper using those approaches and (2) 
developers who designed the approaches, prepared materials embodying the 
appraoches for use in the field, and were responsible for a substantial 
portion of the materials revision process. During the 1978-79 school year, 
the two groups began working with a number of urban, suburban, and rural 
schools to refine these approaches. The Career Preparation Group worked 
with secondary schools while the Basic Skills Group worked with elementary 
schools . 

In 1978, RBS initiated a separate research effort to use the activities 
in schools working with the development groups to learn how schools change 
and how external agencies can facilitate school improvement. The research 
group intentionally ussd naturalistic or ethnographic methods to study 
UwAi oliaitgtf ptwo^es (GuM t 1978; Wolcott, 1975). These methods were 
intended to yield grounded theory, generated from intensive experience in 
schools, about educational change (Glaser and Strauss, 1968). For two 
%*?fir*, Participant observers followed the change processes initiated by 



the development groups in five schools, three working with basic Skills 
and two with Career Preparation. The researchers observed meetings be- 
tween development gLOup staff and the committees of local educacors Involved 
In the implementation of the approaches in specific schools; conducted 
t?xten>ive semi-structured interviews with committee members and other school 
personnel; interviewed development group linkers in a less structured 
manner, interacted socially and professionally with both linkers and 
developers; and compiled massive files of the proposals, papers, and 
materials produced by the two components (Donner, 1980), Most of the 
reports from this research have dealt with the nature of planned change 
in schools (e.g., Firestone and Corbett, 1981). However, the data 
collected also provide the basis for this report. 

Original Intent for the Approaches 
RBS brought over a decade of practical knowledge of the development 
process to this effort, but its thinking was shaped substantially by 
the Rand Change Agent Study (Berman and McLaughlin, 1975) and other 
implementation studies that stressed local adaptation of development 
products. Thiri research was one factor moving the components toward? 
"collaborative development" — an effort to get the schools involved in 
development and to revise materials on the basis of practitioners* input. 
One development group described collaboration as "a working relationship 
in which the expertise each collaborator brings to the task is recognised 
and respected by the other" (Basic Skills Group, 1979, p. 13), an indica- 
tion of a new respect for educators* practical knowledge. Still, since 
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the schools participated in the development efforts to reap benefits for 
their own programs, they were not interested in creating approaches to be 
used elsewhere, Moreover t they had limited previous experience in edu- 
cational development. Lack of school motivation and experience plus the 
older tradition of development combined to place the burden of developing 
the approaches squarely on the development groups. 

The two development groups differed in the knowledge bases they relied 
on, the change process built into their approaches, and in the kinds of 
materials they intended to create. Basic Skills intended to draw heavily 
ou existing research t and even to some extent designed its approach to 
Include research-like activities. This development group relied on the 
growing body of classroom effects literature that correlates instructional 
and classroom management strategies with gains in student achievement - 
[This summary is necessarily brief. The reader interested in more detail 
is referred to the work of oraeber (1980), Helms (19ft0), and Huitt and 
Rim (1980).] The intent was to identify, from research, "variables" that 
teachers and administrators could manipulate to improve student achieve- 
ment. For example, one of these variables was "student engaged time" — 
that is, the amout of time students spend in basic skills learning activity. 
Student engaged time is actually a variable used in a number of studies 
of effective classrooms. Basic Skills expected that most of its "vari~ 
aMes" would literally be variables shown by previous studies to be 
correlated with student achievement in reading, math and language arts. 
The development group devoted most of its 1978-1980 effort to developing 
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a system for diagnosing student engaged time rates in classrooms and for 
lielping teachers identify ways to increase those rates, (This discussion 
of Basic Skills Ls limited to its work on the time variable.) 

The heart of the Basic Skills approach was a cyclical process for 
collecting data relevant to each variable and applying those data to a 
local planning and change process* first, practitioners were to use 
procedures modeled on those rrom the original research to observe and 
collect data on the variable in question, Second, they compared the data 
collected to reference graphs derived from earlier studies to determine 
if optimal levels had been reached, Third they reviewed findings to 
determine what changes were needed, and finally they implemented those 
changes* As appropriate, the practitioners would repeat the original data 
collection activity to $ee if any change had been accomplished. 

Basic Skills developed a Massive body of materials for the student 
engaged time variable. Most were for the first two phases. Initially, 
teachers were expected to observe the classrooms of their peers and count 
the number of students engaged and unengaged in learning activities at 
specific intervals. In later versions, behavior was classified as unen- 
gaged because of management* social, discipline, or other activities. To 
get a reliable data base for comparison, teachers were expected to go 
Into each othar's classroom to observe for several periods. Classrooms 
would be scanned at o&e or two minute intervals, and the number of children 
in each category would be recorded. Then numbers were plugged into a 
formula to gat an engagement rate and compared against reference graphs 
created through a secondary analysis of data from previous studies. 
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h v<-;;tii i : i v. [,4^11 skills compile J numerous manuals, videotapes tor train- 
in. :"!ri»' ,sit \ 1 t^t t - en^urt that teachers mastered the observation 
syj.tijt, nMeremv /m^hs, ami compilations o£ techniques for increasing 

iri- 1,-ri'cr iTt-f ir.it Ion knowledge base consisted primarily of descrip- 
tor i' - -Hint:, vvjrlicr carter education program*, at RFS and elsewhere 
in.! pr.^ranr^at u 5t .itcrwnt s about career education goals and how to plan, 
.m^f (Mno from </xi.->rln:r career education programs, federal and state 

tuff i-iiii .it wn statements, and the practical knowledge of the 

1 ariHT j'l-fi^ra: i«>n a ; 1 (Tareer Preparation, 1979) . Career Preparation's 
t ;iuatn,; .bsumpt inn wj*> that educators should make "data-based decisions" 
when pi -.lining a career education project, but the group emphasised local 
control of the planning process. One linker in the group told a distric": 
tlut "iiidl^idual linkers will wor!. with schools and explain the general 
approach* and schools decide what they want. This is a way which 

iv.^ht bo profitable, ii you want to go this way, we'.ll help; if you 
den t, *x**ll still help you. 11 Beyond this basic assumption, Career 
i'rf imuk ion did believe that successful programs would be experience- 
bu^ed, should huve substantial student and community involvement, and 
should be planned systematically. 

The central activities; of the Career Preparation approach were a 
planning process intended to identify gaps betweeu local career prepara- 
tion goals and actual school performance. First, a committee of schoo.* stafi, 
students, and community residents identified goals for , project. Next. 
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Uic^e > T oa1 &> were used to generate surveys to identify community, student, 
■md 'Xitff i>errcH>f ot career education needs. These surveys t%ere used 
to resfne the initial petals* Then school and community resources were 
identified. Afterwards a program was planned, implemented, ana evaluated* 
The ^ruup Mm^ested that a successful program might "infuse* 1 career 
education into existing curricula, or use mini-courses, special events, 
work experience, and the existing guidance program to meet its goals. 

In keeping with the emphasis on local decision-making, the materials 
developed by Career Preparation were like a library, There were many 
resources for participants to c'uoo*a from, but there was no single package 
or programmatic set of materials for developing a project, 

Practitioner Response 
feachers and administrators were active recipients of the RttS ap- 
proaches who brought substantial practical knowledge to the task. Some 
this knowledge had to do with how to teach, but it also pertained to 
coping with the school as a workplace. That is, teachers knew what their 
rcs]\»n*ibil it ies were and how much time they took, how long a "reasonable 
wotk day" was, and vhat norms had to be followed to get along with their 
colleagues* Teachers evaluated the RBS approaches in light ox all of this 
knowledge, 

Basic Skills » Teachers working with Basic Skills 1 approach us^d 
their knowledge of instruction to assess that approach in general as well 
as its specific aspects. They were not concerned a great deal with the 
technical reliability and validity of the observation and comparison 
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j)rcn:eflfi the development group developed. Rather they judged the approach 
in terror of its congruence with their beliefs and values about what 
"works/* The whole concept of increasing students 1 time engaged in learn- 
ing had considerable face validity and generated enthusiasm among numerous 
teachers, tn fact, teachers in two sites implemented strategies to in- 
crease the amount of time students spent on their work even before ttain- 
itig on data collection and comparison had been completed. Where the 
"data" conflicted with practical knowledge, however, teachers often 
followed their experience. For instance, the Basic Skills* reference 
graphs suggest that more engaged time is usually better. But one teacher 
did not want to increase the time spent in a subject area arguing that 
"forty-Cive minutes is plenty enough for a first grader... I'm not going 
beyond that. 1 ' Several others claimed that children need breaks and 
changes in what they do to get the most out of a lesson. Observational 
data in one school indicated that the biggest loss of time was in the 
transition from one assignment to another. Yet, the teachers argued 
that "in this school the number one problem is discipline" and proceeded 
to implement changes to reduce disorder. 

Teachers also knew that they had a number of tasks to complete besides 
participation in the project and felt responsible primarily for instruc- 
tion of their classes. Many contained about the time involved claiming 
that "our main problem is that we didn't know how much time it would en- 
tail, 11 and "It seems to have its good points* but it's taking up so much 
time that I can't get to my regular work." 
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Practical knowledge about instruction was changed by training In" 
the Basic Skills approach, but these changes were rnore conceptual and 
Informal than procedural. They reflected as much a form of what Weiss 
(1980) calls enlightenment knowledge as skills development or the rote, 
hifth-fidelity implementation of procedures. EducStors trained in the 
approach rarely used the diagnostic process for assessing engagement 
rates as it was designed by the development group. Instead, bits and 
pieces of the process were incorporated into their working %ags of 
tricks" for teaching and administration. For instance, several teachers 
and principals informally adopted the activity of scanning a classroom 
to identify how many children were engaged in learning activities. This 
was a simplified version of the formal observation procedure developed 
as part of the Basic Skills approach. Two principals incorporated it into 
their strategy for classroom observation, and teachers reported that they 
scanned the class as a whole more systematically after training than they 
did before. Teachers also incorporated new concepts and ideas into their 
way of thinking about their work. One teacher reported, "RBS did point 
that out to me that you do lose a lot of time passing out and collecting, 
in the management part of your day.., and your instruction time can be 
added on to by having mora things readily available." Thus, lessons 
from Basic Skiils' approach were incorporated into their practical 
knowledge . 

Career Preparation . Paradoxically, Career Preparation suffered from 
the absence of practical knowledge in one respect. Teachers were unfamiliar 



with che idsa.of career education. One linker explained that "the 
first thing we learned when we came to defining career education and 
developing career educition goals, it went on and on and on.**. Many people 
on t„£ local plrnning team had never hoard of career education before." 
Because of their la*:K of knowledge* school staff could not always make the 
independent contribution to local decision-making that Careor Preparation 
expected * 

Still, practical knowledge was used to supplement "data based" deci- 
sion-making. For instance, after needs assessment results were examined 
at one school, teachers felt that some goals relevant to career education 
hdd been left out. Although data on those goals were missing, they were 
still incorporated into the project. Practical knowledge also guided 
project design. Because several administrators had adverse experiences 
placing stadents in work settings before* community involvement was mini* 
mi zed. 

As in Basic Skills, members of Career Preparation teams reported that 
awareness of career education became part of their practical knowledge. 
Several found themselves looking for potential career education activities 
as examples while working in other curriculum areas. 

Revising the Approaches 
Field staff and developers reacted to practitioner usu of the approaches 
in somewhat different ways. The field staff had to make immediate adjust- 
ments to keep local projects operating while providing feedback for future 
I'W'ltvt tlrtrvli'iflm*"*. They tfpent a great deal of time developing and 
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maintaining trust and support for the component efforts. The adjustments 
they made were part of the mutual adaptation process in each site. But 
by them s elves , these adjustments had little cumulative impact on the 
revision of the approaches. However, the developers learned from the 
field staff. The developers made changes in the underlying conceptual 
frameworks, the steps to be followed, and the actual written materials 
that incorporated modifications made by the field staff and had long term 
consequences for the approaches. 

The Field Staff 

Basic Skills . Basic Skills field staff responded to teachers* con- 
cern about the time required by Che project and lack of interest in 
fidelj*/ to the original research base. One response was to reduce the 
time devoted to early phases of the approach. The amount of time for 
initial observation or data collection could be reduced by cutting the 
number of observations. As the number of observations was reduced and 
sampling plan altered, the ^liability of results and validity of com- 
parison to reference graphs declined. These changes threatened what 
Basic Skills staff called the "technical integrity" of the research base— 
that is, the similarity of the original research procedures to those in 
the approach. 

This threat lessened the extent to which the development group could 
argue a truth claim for their approach based on the use of scientific 
procedures (Dunn, forthcoming). However, as noted above, the educators 
with which the development group worked were more concerned to apply 
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utility tests than truth tests (Weiss, 1980), Reduction of obaervation 
time did not seriously undercut the contribution of training in the 
approach to teachers * practical knowledge of the importance of time on 
task* This loss of fidelity to the original reaearch — a form of cooptation- 
may have contributed to the usefulness of the approach* Teachers observa- 
tion time could also be reduced by assigning the observation task to 
administrators* However, where teacher-principal distrust was high, there 
were serious objections to this approach. Thus, it was difficult to build 
this strategy into the approach on a uniform baals. Its application became 
a matter of field worker judgment. 

A third way to cut time demands was to shorten training* Generally, 
teachers were most restive when diacusaing the conceptual framework and 
the observation and comparison activitiea; they were most intereated 
in the Identification of new instructional atrategiea. As neceasary, field 
people made spur-of-the-moment decisiona to reduce training on the first 
two phasea to get teachers to materials that engaged their attention. 

Career Preparation * While the Baaic Skills field staff had to reduce 
the amount of material presented, thoae in Career Preparation had to add 
to it. In keeping with their interest in atrengthening local decision- 
making, the Career Preparation staff originally told school teams that 
they would take a "back seat" and that "you should treat what I have to 
say as if I am just another member of the team." However, the field ataff 
quickly moved into a more active role in moat aitea for two reasona. Firat, 
they felt obligated to provide a certain direction to the project by empha- 
sizing a broad definition of career education and by keeping teams within 



tha general framework of the process model. Second, participants seemed 
unable and unwilling to shape the development of local projects, partly 
because they did not fully understand the concept of career education* 
As a result, field staff helped organize survey results and goal statements 
and often led team meetings. In one site they actually wrote the projects 
goals and objectives. 

Field people in both development groups also facilitated the use of the 
approaches by developing positive personal relationships with team members 
at the site* These relations were used in a number of ways. The field 
people were able to intervene between teachers and administrators and keep 
pre-existing tensions from affecting chango efforts. They could listen 
sympathetically to complaints about the Approaches, thereby defusing dis- 
content, and they could relay such complaints to developers. This use of 
interpersonal skills proved to be an important part of the practical 
knowledge of linkers *nd helped keep the local projects operating (Corbett, 
1980). 

O cvel o peirs 

Basic Skills , Basic Skills developers saw the largest changes as 
"have(ing) to do with the complexity of what we tried to do. We've tried 
to diminish the time requirements again and again and we are still trying 
to get them down even further. " The simplification took two forms parallel 
to those initiated in the field. First, the amount of time required for 
classroom observation was significantly reduced, and a number of alternative 
plans for scheduling observations were developed to increase flexibility 



9 

ERLC 



-15^ 



19 



for observers Second* there was a general trend to simplify and 
decrease the amount of materials presented to teachers* The group 
has prepared one set of materials presented to teachers that covers basic 
concepts and a more elaborate leader's guide* With the help of this guide, 
an administrator or external helper acting as a leader can supplement the 
basic materials as needed, 

A second change was a more subtle reassessment of how the change pro- 
cess initiated by the approach would work* The original assumption guiding 
the project was that if teachers would carefully follow the procedures 
of the approach and if high fidelity to the initial research were main- 
tained i then achievement scores would rise. This assumption is now being 
supplemented by a newer view that the project is not teaching procedures 
but concepts. Developers are now stressing that one of the important 
benefits of the project is that teachers and administrators are developing 
new "images" of what classrooms with high student engagement look like and 
as a result are better able to plan. In sum, there is a move towards 
recognizing and attempting to strengthen teachers T practical knowledge. 

Career Preparation , Developers in Career Preparation were spurred 
to create more materials as a result of responses in the field. Apparently 
as a result of feedback from field staff, the development group created 
a set of booklets that presented information on implementing career educa- 
tion projects. These booklets provided a definition of career education 
and identified strategies for developing and implementing local programs. 
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Regularities anH Variation In the Development Process 
Together these case studies suggest that the view that development 
is * means of putting research Into practice massively oversimplifies 
wliat takes place. Somehow* through the process of trial and revision* 
research and practical knowledge are integrated* aggregated* or combined 
into something new, KBS* recant experience illustrates some of the com- 
plexities of the development process that were not considered when large- 
scale development efforts were first funded by the federal government. 
It also suggests some regularities and variations in the development 
process chat future developers should take into account. 

1. Multiple practical knowledges must be considered in educational 
development . Teachers* administrators* linkers* and developers all have 
stores of practical knowledge that can contribute to development* Practi- 
tioners 1 knowledge is part of a larger culture including core understand* 
ings and values. This culture is pragmatic* practical* specific* concrete* 
and personal (Lortie* 1975; Jackson* 1968)* It is a necessary basis for 
day-to-day decision making and helps teachers cope with the exigencies 
that are often unanticipated by researchers. Teachers* adoption of spe- 
cific practices and new ways of looking at the classroom and their 
resistance to more abstract procedures and definitions are all part of 
a filtering of research-based developments through that culture. The 
adoptions they do constitute incremental change in that culture. 

Field staff also have a practical knowledge* an expertise in group 
dynamics developed through previous work with the "nuts and bolts" of 
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implementing projects in schools. Thfs knowledge helps linkers facilitate 
implementation by anticipating and responding to interpersonal and motiva- 
tional barriers that develop in the field. Finally, developers have some 
sense of what works and what does not and of how to organize the develop- 
ment process, all gained from previous efforts. This knowledge is general, 
but they also know how important it is to create field test situations to 
develop more specific knowledge about how particular projects work. 

2 . Ther e may be a "g ol den mean" in prestructuring development prod - 
ucts . Development products are usually modified during implementation 
(Herman mid McLaughlin, 1975). To developers and those concerned with 
fidelity of Implementation, this modification ofbM looks like an adap- 
tation to a school site that dilutes the new contribution the product 
can make to education. To teachers, this same process may look more 
like the incorporation of useful ideas and procedures into their fund 
of practical knowledge and sorting out the dross. Whether what is useful 
is preserved depends in part on Che product and in part on the state of 
local practical knowledge. 

The RBS development groups tried to ensure that local modification 
of their approaches would preserve the useful contribution inherent in 
those approaches by building in a role for human agents who understood 
the approaches and could learn about and adapt to specific local contexts. 
However, the nature of the two approaches led to different kinds of re- 
actions in the field as well as different kinds of changes through further 
development. Basic Skills developed highly prespecified procedures for 
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collecting and analyzing data on instructional processes although it 
left considerable leeway on what new practices to implement* However, 
practitioners initially found the procedures inflexible and time con- 
suming. Substantial simplification took place over the two year period. 
By contrast, Career Preparation consciously avoided elaborate prestructur- 
ing. It relied instead on a few precepts, a generalized planning process, 
and the practical knowledge of its field agents. Field trials indicated 
substantial confusion among practitioners on what career education was 
and contributed to increased specification of materials and activities 
to provide clarity* Together these experiences suggest that some intro- 
ductory explanation and structuring ia necessary, but that balance is 
required to allow local flexibility without promoting confusion. 

Optimal prestructuring of development products will depend in part on 
the knowledge base available to developers and the way it is to be used. 
The basic skills area is currently characterized by an extensive body of 
research on what works, considerable clarity on what intended outcomes 
should be, and a relatively advanced technology to measure those outcomes. 
With this large body of knowledge to draw upon, there is substantial basis 
for prestructuring materials although leeway must be given to allow prac- 
titioners to employ their practical knowledge. By contrast, career educa- 
tion and other fields have much weaker bases of research and technology to 
draw upon although a number of sophisticated pro* 'ans do exist in these 
areas. In these areas it seems appropriate to minimize prestructuring to 
encourage practitioners to take advantage of whatever practical experience 
they have. 
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i* Development can be a two-way street * The extent to which a devel- 
opment effort approaches the "one-way" or "two-way" extreme depends on both 
the mechanisms built in for communication with the field and on the content 
of that communication. The pure case of one-way communication where in- 
formation flows only from researchers through developers to disseminators 
.-md users is probably rare. The very act of field testing initiates some 
feedback* The use of formalized instruments — questionnaires to assess 
user satisfaction and the usefulness of various aspects of a product — is 
one step towards increasing two-way communication* However control of 
the process remains with the developers. Another step is taken as 
instruments are supplemented or replaced with a human field agent who can 
identify unanticipated uses, misuses, or problems with a product and be 
influenced by school people. A field staff can also act as advocates for 
the schools within the development organization. A final seep involving 
full collaboration is achieved when school people and developers work 
together directly, sharing the goal of creating a product and responsib- 
ility for its accomplishment. RBS* current development effort was at the 
third level of interaction. A field staff was employed for interaction 
with schools, but for the most part there were both a clear division of 
labor and different expected benefits for RBS and cooperating schools. 

The content of communication from schools to developers also varies. 
Any field testing collects information on how understandable and usable 
a product is and whether it "works*' — that is, achieves intended levels 
of student growth. The knowledge base for the product will still come 
from the community of researchers and, perhaps, other developers. With 
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inu*rn*tive communication between developers and schools s however, uduen- 
tor;/ j*i7iLtir;il knowledge can also be identified and built into development 
i>roiiucts, Then the very substance and design of a product reflects 
tiMcher- and administrator-generated knowledge. RBS ' current experience 
su^l'sls that future development work would profit from developing mech- 
anisms that permit cooperating schools to contribute not just information 
un whnt works, but also practical knowledge that enhances the final 
product* 
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